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AppttejuH's or agent's file reference 


FOR FURTHER ACTION ^ N6l, " flca i ioM ^ 

H!«ofnfTmiion Renon < Ponn PCT/IPGa/4 1 6) 


Intenwiiooul application No, 
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3DncCEMO£R 1999(30,12,1^) 
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EASY SOFTEC CO., LTD. ci «l 
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t. WW regard to the elements of the IntemoifofflLt flppllcieiofi:* 

(SQ the fmerntttiwml tippltctilion «s erigrnfllly JtJed 
Q the discretion: 



, filed with the Iclierof 



,as original Hied 
.fiWtvilh the den wnd 



| | the claims: 

W* , 

TOPS 

pages ^ 

pages 



, tt] originally filed 

, as ammdtsd (totjetner with wiy stalmcnt) under Articte I 
. filed Htf) the demand 



, filed with the tetter of 



[3J thfifaiwings: 

PS&eS — 
panos 



the sequence IfcUnp, pent of the description: 
page* , 

P*&* _ 

pages ■ 



, filed wtih the letter of 



v fls originally (Bed 
, filed with flic demand 



, filed with the letter of 



, as origlnplty filed 
. filed vrth fhc demand 



2. Mth ^gard to the Iw^Uasc &U the elements maifcat above were available or finished to this Authority fti tte binnufee In which 
the International Application wa? filed, unless otherwise Indicated undnr (Ms ftcm. 

The* elentents were available or fittnldhod to this Aiittor i| y in the fblfowiife language which is 

CJ the Inn^mvgc of a translation Attnlshcd for the purposes irfwtoniatlonol somen (under Rtrtc 23.1(b)). 

□ 

the language of publication of ate International appllc*ton(undcr (tide 45.3(b)). 

□ thc ,an fi u ^ of the translation furnished for tfift purposes of International preliminary OTntnaltentiirMter Rules 55.* and/ 
or $5 .3), 

, With regard to any nucleotide and/or amino ftcld fieqwn«dMoM in t&e Internal? onal application, thc intemationAl 
preliminary exnmitwtfoo Vns carried out on (he tans of the sequence I feting 

□ 

comniiHxl in thc tntemmfonAl afpUcmTcm written form 
CD 1 ted together wfttj iho fntmattonttl appf teaUon In computer readable fonn. 
PI wished rotacqucntry to thfa Authority written form. 

□ fiimfcimj pubvequcntfy to mis Author^ in oomputcr rcntfflWc form 

□ J** 8t,rt£mcnt ^ 11,41 subsequently tumrshed written sequence HsUr* does not go beyond the disclosure In the 
lAtomfltional npplfcfttionas ns filed Jtw been furnished. 

□ ^ ^atemcntftmthcfefoTTOation recorded lit computer reodftbfe term is identif*! to the written sequence listing ho$ 
been fit rof shed. 

[ I TT\e amendment* have resulted in the cancellation o£ 
the description, page* 
r~l thc claims, Nos. " 



Q the drawings, sheet 



$. O Vfo d *»* «■ tffr*™* A* frm=n Jnwint» W «ut been mad*, aot* they Iwva ^«r> ^fdcred to go 

beyond thc rffscteurc aa filed, as indicated in the Supplemental Box(fcii!e 70Jt(c)) 

* teptacanext sheet* whlcti ha* been /writhed to tht receiv^ O^ce /« ^/i«f ;o an iMueftm /inre/f! 14 art referwl to 
tntMsoptottmo* or^afiyflkd. * and are net annexed m ,/^, do ^ «ww*wfl?*r »/d 

o/»ff 70, 

"tmioMng nth wnendmem mm be vfirrod 0 mtcrttem I ana towveut 10 Ms repen. 
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PClTKftWOQttS 



V- Rcnaoned statement under Article 35(2) with regard to novelty, inventive «tcp or industrial applicability; 
citations and cxpbmatfrn» supporting $ud» rtatentciif 



I. Statement 
Nowlty (N) 



Claims 

CWtns 



Claims *~13 

Claims 



rr>du^iri«1 Applicability (JA) Claims < ~f3. 




2. Citations and explanations (Rule 70.7) 

The subject matter of present claim differ therefrom in that caption 
function is added to MP3 data format, and this teaching is not rendered 
obious from the prior art. 

Thus the novelty of the subject matter claimed can be acknowledged, and 
also the subject natter of the claim Irfeppears to involve an intensive step 
in the sence of ART 33(3)PCT as well. 

The industrial applicability of said subject -matters is self-evident. 



Form PCT/IPGA/W (Box V) (July t998) 



Ibis Page 



Blank lusplo) 



-if 



2001-JUL-05 16:06 FROM : INTELPROS 



8222853652 



TO: 



P. 003 



PCT 

REQUEST 



The undersigned requests lltat the present 

international application be processed 
according to the Patcnc Cooperation Treaty. 



• For receiving Office use only . 



International Application No. 



International F iling Dat e 



N?™ c ?fo^ c 'y* n g Ofltec ond "PCT International Application" 



Applicant 1 * or flgeot'a file reference 
(if de,iit*d) (12 chorectm maximum) 



FPE99005-PCT 



Bo* No. I THLt OF INVENTION 

MP3 PLAYER HAVING A OPTION DISPLAY FUNCTION, MP3 DATA BDRMAT 
and Treppfrrr-ron Marram Twrapre 



Box No. fF APPLICANT 



of residence is indicated below.) 

EASY SOFTEC 00. , LTD. 

3rd Floor f Sunghyun Building, 649-6 # 

ydksain-Dang, Kangnani-Ku, Seoul 1 35*080 , 
Republic of Korea. 



| | This person is Alan inventor, 



Telephone n„. 

82-2-508-1605 



Praimitc No. 



82-2-562-9768 



Tcfeprjrtlcr No, 



.State (thai is. Country) ol" nationality: 

KR 


State (that is, coiaitry) of 


residence; 

KR 


This person is applicnnt | | atl Auipwtcd r~i att tfeslmated SlalM <*«pl 1 — 1 (he Unilcd SI«ka 1 — 1 the Slates indicated m 
tor the purposes of; 1 I Slfltc* {JSJ th* United Sttties of Amcriw 1 | of America only | |the Supplemental Ron 


Bet No. Ill FURTHER APPLICANT(S)AN0/OR (FURTHER) INVENTORS) 


Name nod address ffamtfy name followed by flrVen name; far a legal entity, full official 
dtsimatwn 7he address must irtcitkhpostarcode The country aft!* 
address (ndfeatedfn this Box is the applicant 's State (that is, country) of residence Una State 
of retiree is indicated below.) " r,yf J 

KOH, Young Foon 

#201 Saeseoul Apartment, 46, Banpo-Dong, 
Seocbo-Ku, Seoul 1 37-040 , Republic of Korea 


This perron w: 
j^j Applicant only 

] %J applicant and inventor 

| ] inventor Only (If this cheek-box 
^ u marked, do notfiil m below J 


Stale (that is, country) of nationality; 

KR 


SUtc (thai H country) of residence: 

KR 



This person Is applicant 
for the purpose* of: 



□ All designated fl Alt dcaioutlcd Sbttca swept 
SUtei | I the United Sutra of America 



rri the United SUIm 
W\ * of Amcricn only 



□ Ox Sistcn Indicated to 
the Supplemental tlox 



□ 

Further npplicnntn and/or (further) inventors are indicated on a continuation sheet. 



Box No. IV AGENT OR COMMON REPRESENTATIVE; OR ADDRESS FOR CORRESPONDENCE 



The person identified below is hereby/has been Appointed 1o act on behalf 
of the Applicant(i) before the competent Internal tonal Authorities as; 



Lxj agent common representative 



Name and address: (Family natve followed bygiwn name; for a Ufjof entity, full official 
designation. The address nmsl include postal code and name of country,) 


TttlephoAd No. 

82-2-2279- 


-3631 


KIM/ Seong Talk 


KacflfmJJe No. 




148-28 Ulchiro 2-Ka, Chung-Ku, Seoul 


82-2-2273- 


-4605 


100-192, Republic of Korea 


Toleprtntcr No, 



□ Address for eorrespond«nc«; Mark this check-box where no agent or common representative is/has been appointed and the 
space nbovc is used instead to indicate a speciat artdrciM to which corfeapoftdenoe should bo sent. 
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ShoctNo. .2. 



Pox No.V DESIGNATION OP Static 



N^ii^tr/o^^ 

U AE United Arab Emirala n 

AL Albania ^ 



□ 

a 



AM Armenia 



LR Liberia 
LS Lesotho. 



D AT Auslria 0 LT Lithuania 



BA Bo^U.ndHcrzegoyiM 5 MD Republic of Mo Wcvn 



□ AU Australia 
D AZ Azerbaijan 

□ 
□ 

D 
□ 
□ 
□ 
□ 



□ 

a 



Ltl Luxembourg 
LV Latvia 



BB Barbadoa 

BC Bulgaria ^ 

BR Brazil * \ 

BY fielani* . . 9 

CA Canoda ° 



vnuui)PniHiain junwnicnaicm f-i 

□ CN Chin* g 

□ CU Cuba 2 

□ CZ CaechRepuWia O 

□ DE Germany ° 

□ DK Denmark "J g 



MC Madagascar 
MK The former Yugoslav Republic of Maocdonii 

MN Mongolia 

MWMilawf 

MX Mexico 

NO Norway 

NZ Key/Zealand 

PL Poland 

FT Portugal 

RO Romania 



□ RS Spain 

Q n Finland 

13 GB United Kingdom 

□ CD Grenada 



SD Sudan 

SE Sweden 

SG Singapore 

St Slovenia . . 



□ CB Oeortfa S SK ******* 



□ CM Ghana. 
O CM. Gambia 

□ HR CrciU 

□ HU Hungary , 

□ ID Indonesia 

□ JL brae! ... . 

□ IN India.... 

□ IS Iceland 

□ JP Japan , ... 

□ KB Kenya.... 



KG tCyr B yziun q 

KP Demoemlic Peopled RcfwMic of Korea .... pi 



SL Sierra Leone 

□ TJ Tajikistan 

□ TM Tiirfcmenfetan 

□ TR Turkey 

□ TT Trinidad jind Tobago ... 

□ UA Ukraine 

□ UC Uganda 

E US United State* of America, 

□ UZ UibelciiUn . . [ [ [ 

□ VN VklNam 

YU Yugoslavia 

ZA South Africa 

ZW Zimbabwe 



KR Republic of Korea ~ u . . . , M . . 

&^ te re ^T f ^f«MM fcfc 

LC SainiLuoia q 

LK Sri Lanka g 
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Sheet No. 



Bo» No, Vf PRIORITY CLAIM 



Q Further priori ly clnlma arc initialled in the SuppJcrrmnlfll Dos 



Filing date 
oi'ciriiisr application 
(doy/ntofith/ycar) 



Number 
of en rlicr application 



Where earlier application is: 



H«itiOhi(l Application: 
country 



regional application: 
regional Qftkc 



international application: 
Kceivmg Office 



iwm ( I ) 

08 January 1999 
(08. 01, 99) 



1999-235 



KR 



item (2) 



item <3) 



1 [ The receiving Office is requested to prepare and transmit lo the FntcrnationaJ Bureau a certified copy 
— of the earlier oppliCAtion(i) (only if the earlier application was filed with the Office which for the 
purposes of the prrsmt international application if the receiving Office} identified above ua itcm(s); 

' tvhrr* th* writer application tt an ARUO application, a tt mandatory to indicate rn the $nppt*m*ntal Ha* at l*att on* cowtiy party to the Pom 
Co*v*fitionf'or the Protection affnthtttnot Pivperiyfor which that earlier application was filed (Rut* 4.10(b){t<)}. Sen Sttpp Omental Box. 



Bo* No. VH INTERNATIONAL SEARCHING AUTHORITY 



Choice of Jntern rttlnnnl Se*rehin£Authority<TSA) 
of two or more International Searching Attthonttet are 
competent tn carry out the internantmol March, indicate 
the Authority chosen: the r*o4cuer code may he. mrd) \ 

ISA/ KR 



Request tu u« re,mlr.i of writer »*t»rch; reference ta th*t search (if on «rr/f*i 
tearch htti been earned out by or reipmttHt Jro* the tmtrnanoaot Searching Authority), 



Date (aay/montMyear) 



Number 



Country for vectorial Office) 



Box No, VIM CHECK LIST; LANGUAGE OF FILING 



This international application contains 
the following number of sheets: 

rcqucat 3 

description (excluding 

sequence lilting part) 16 

claim* ; 6 

abstract 1 

drawings 5 

sequence listing part 

of description ; 



31 



Thffl international application U nccornpjtnlcd by ihc Ucm{») merited bclowi 

1 . □ fee calculation sheet 

2. □ separate signed power of eltorney 

3 □ fi °Py of gcnenl power of Attorney; reference number, if any; 

4. p rtotemcnt explaining lack of signature 

5. □ priority document(a) identified in Boy No. VT 0a ilem(a): 

6. □ translation' of international application into (Ian Ruaoe): 

7. □ «pw»l« indication?! concerning deposited mieroorganiam or other biological material 

8. Q nucleotide and/or Amino add sequence listing in computer readable form 



Figure of the drawings which _ , 
should accompany the abstract; figure 1 


Language of filing of the 

international Application: Korean 


tox No. K SIGNATURE OF APPLICANT OR AGENT 



Mur to nxh signature, indicate the i hj ii l afihcpcrrory jjjprtjiy and rhm mytiL/y tn which the pmnttm tfgra ftfmch cttpvstty tor*tl pWwp/w mdin^ afce reqn*t tf. 



KIM, Seong Talk 



\ . Dale of acluat receipt or the purported 
international application: 




2. Drawings: 
| j received: 


X Corrected date of actual receipt due to later but 
timely received papers or drawings completing 
the purported international application: 


4. Date of timely receipt of the required 
correction* under PCT Article 1 ] (2); 


("1 not reeeived: 


5. Inlernational Searching Authority joa / 
(if two Or more ore competent): 1 / 


fi. r 1 Transmittal of acarch copy delayed 
LJ until search feu is paid. 





tor International Bureau use only . 



Date of receipt of Ihe record copy 
by the International Bureau: 
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PAYMENT OF FEES FOR INTERNATIONAL APPLICATION 



To - Commissioner of 

the Korean Industrial Property Office 



International 
Application No. 



Applicant 



Agent 



Name 



Address 



Name 



Address 



EASY SOFTEC CO., 
LTD. 



International 
Filing Date 



Residence 
Reg. No, 



KR 



Priority 
Date 



Country of 
Nationality 



8, l. 99 



KR 



3rd Floor, Sunghyun Building, 649-6, Yeoksam-Dong, Kangnam-Ku, 
Seoul 135-030, Republic of Korea 



KIM, Seong Taik 



Agent's 
Code 



9-1998-000019-9 



TeL No. 



82-2-2279-3631 



148-28, Ulchiit) 2-Ka, Chung~Ku, Seoul 100-192, Republic of Korea 



Kind of Fee 



Amount of Fee 



[ X ] Transmmittal Fee 
[ X ] Designation Fee 
[ i Confirmation Fee 



[ X ) Basic Fee 
[ X ] Search Fee 



W 1,147,900 



Submitted hereby is a payment of fees pursuant to Article 103 of the 
Enforcement Regulations of the Patent Law. 

Date(day/month/ycar) 30 December 1999 

Applicant (Agent) KIM, Seong Taik (Seal) 



& Attached Documents) : 

A copy of the certificate of payment of international application fees 
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FEE CALCULATION SHEET 
Annex to the Request 



Applicant ct agent's 

file reference FPK99005-PCT 



Applicant 



For receiving Office use only 



International applet ion No, 



Pate atamp of the receiving Office 



EASY SOFTEC 00- , LTD* et al. 



CALCULATION OF PRESCRIBED FKRS 

1. TRANSMITTAL FEE 

2. SEARCH FEE 



45,000 



J3 



KR 



InlcnutioflAl search to bo curried out by ^ 

% Ink ^ a ^t Starching AtihfiTilia m emprtmt in rtfatlon to the btrrnattawl 

eppttcctkm, tufa* fhenamtf tkeAaforty which is tkom to curry <*t the htmrionatxarchj 

3. INTERNATIONALIZE 
Raalc Fee 

The mtcrnattoital application contains 31 ahecta. 

firataOahcets | 489/600 

1 



150,000 



J3 



_ * 11. 300 
renwmlnR sheet* Additional amount 



" I 11,300 M 



Add ameund entered Mbt md 1i2 dihI enter total MB , , , , I 500,900 [o] 

I 4fi2.nnn f^] 



Designation Fees 

The international application contain* 4 designatkma 

, , 4 * HfrOQO ■ 

number of designation fees amount of designation fee 
payable (biaxtrnnm 10) 



Add amounts entered i!B and Daiwlcnlef total at I L 952,90 0 ITl 

&J^f^f^ certain Stauv' an entitled to a reduction of 75% of the — ' 

*™^^*lfe*.Jr1^ ike 
ton! & be tittered at I fa 25% of the w of the amotmtr entered at B mJD.) 

4. FEE FOR PRIORITY DOCUMENT (if applicable) [7] 



5. TOTAL FEES PAYABLE 

Add amounts cnlered al T, S, I and P.and enter totaj in the TOTAL box 



TOTAL 



□ 

The designation foes arc not paid at this time. 



MODE. OF PAYMENT 

□ authorization lo charge i — i 

depenit Account (see below) | | "^drati 

I] «hoq<« [x] «uh 

I] P°^l money order Q revenue ttarups 



eoupans 
olher (specify): 



DEPOSIT ACCOUNT AUTHORfZATfON (this mode of payment may not be avertable at alt receiving Offices) 
^ — Q ld hereby authorized to charge the total foes indicated above to my deposit account. 

Pi fi^f****^ "5? ** ******* ""lyjffc condition* for deposit Accounts if the receiving Office so permit) is 
» hereby authorized to charge any deficiency or credit any overpayment In the total feea Indicated above lo my 
dcposi t account. 

CH n,!!^ r"wr£?S? f<> 'jW** fcc for P«P«f«Uort and IranymiflaJ of the priority document to the International 
l ~ i Bureau of WIPO to my deposit account. 



Deposit Account No. 



Dale (daytmonfyecr) 



Signature 
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(30) Priority Data: 
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(71) Applicant (for all designated States except US): EASY 
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(57) Abstract 

A caption MP3 player having a caption display function of displaying caption information in synchronism with corresponding audio 
information when the audio information is outputted on stereo, a caption MP3 data format and a method of reproducing the caption MP3 data 
are provided. The caption MP3 player includes a storage section to which the audio information and the corresponding caption information 
are inputted and stored therein, a signal separation section for separating the audio information and the caption information provided from 
the storage section, a control section for controlling storage and output of the information through the storage section and controlling the 
audio and caption information separated by the signal separation section to be synchronized with each other, and a caption output section 
for outputting the caption information synchronized with the audio information that corresponds to the caption information and is outputted 
from the audio output section. 
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CAPTION MP3 PLAYER HAVING A CAPTION DISPLAY FUNCTION, CAPTION 
MP3 DATA FORMAT AND METHOD OF REPRODUCING CAPTION MP3 DATA 

BACKGROUND OF THE INVENTION 

5 [Field of the Invention] 

The present invention relates to a caption MP3 player having a caption display 
function, caption MP3 data format and method of reproducing caption MP3 data and in 
particular, to a caption MP3 player having a function of displaying caption information on a 
display device in synchronism with corresponding audio information while outputting the 

10 audio information on stereo, a caption MP3 data format and a method of reproducing the 
caption MP3 data. 
[Description of the Related Art] 

Generally, MP3 means MPEG (Motion Picture Expert Group) Layer-3, and belongs 
to the audio technology in the MPEG field. MP3 is an audio file format that is formed by 

15 compressing existing data by audio data coding without deterioration in sound quality. Such 
an MP3 file has an AAU (hereinafter, "audio decoding unit") recording format. In other 
words, the MP3 file comprises a header, cyclic redundancy check (CRC), audio information, 
and auxiliary data. Usually, the MP3 player playing MP3 files is used as a dedicated audio 
appliance for receiving compressed audio files and reproducing them in the form of audio 

20 information. 

The conventional MP3 player mounts a liquid crystal display on which, in addition to 
the audio information, simple character data (e.g., a simple reference such as a title of a song) 
is displayed. However, such character data cannot synchronously display a character, i.e., 
the caption information, which corresponds to the audio information. 
25 In the conventional caption tape type using a cassette tape, the caption information 

and the audio information are stored on two tracks of the tape, respectively, that is used 
exclusively for audio. The audio information and the caption information are outputted to 
the speaker and liquid crystal display, respectively, by the caption cassette player. 
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However, the caption tape type, in which the digital signal of the character data is 
converted into an analog signal and stored on the tape, has some problems when reproducing 
the data. The problems are that: the character signal results in noises by interrupting the 
audio signal; the audio signal results in an error in the character by interrupting the character 
signal; or the audio information is outputted on mono, not stereo, by storing the character data 
in one of the tracks on the tape. 

To solve the problem of mono output in the caption cassette, the tape is divided into 
four tracks or output is achieved in the stereophonic mode by signal synthesis. However, 
when four tracks are used, the player should comprise a four-track head to process the data on 
each track. When the data is outputted in the stereophonic mode by the signal synthesis, 
signal loss may occur during the analysis of the signal since it is not possible to completely 
divide the synthesized signals. Moreover, both signals result in noises by interrupting each 
other when reproducing the audio information. 

SUMMARY OF THE INVENTION 

An object of the present invention is to provide an MP3 player having a caption 
information display function of storing audio information and corresponding caption 
information in an MP3 recording medium and reproducing the recorded data by 
synchronizing the data with each other, and provide an MP3 data format and a method of 
reproducing the MP3 data. 

An MP3 file according to the present application comprises standard MP3 audio 
information and caption information having data to display the audio information in the form 
of characters, and thus is referred to hereinafter as caption MP3 data or caption MP3 file. 

In the reproduction of the caption MP3 file, the audio information to be reproduced 
and the corresponding caption information should be synchronously outputted. For the 
synchronization of the audio information and the caption information, position data and time 
data can be used. Both or only one of the position data and the time data can be used. The 
position data may be that of the audio information that should be synchronized with the 
caption information or that of the caption information that should be synchronized with the 
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audio information. The time data is to indicate the display time of the caption data that 
should be outputted through a display device. 

The caption MP3 player according to the present invention reproduces the caption 
MP3 data comprising audio information and corresponding caption information (the caption 
information including position data and/or time data), the audio information having a standard 
MP3 file format comprising a header, audio data and auxiliary data, the caption MP3 player 
comprising: a storage means for storing the audio information and the corresponding caption 
information inputted thereto; a signal separating means for separating the audio information 
and caption information inputted from the storage means; a control means for controlling the 
storage and output of the information through the storage means and controlling the audio 
signal and the corresponding caption signal, which are separated by the signal separating 
means, to be synchronized; a caption output means for outputting the caption signal 
synchronized with the audio signal, which corresponds to the caption signal and is outputted 
from the audio output means, by inputting the output from the signal separating means. 

The caption MP3 data format according to a first embodiment of the present 
invention comprises an audio information and a corresponding caption information, the audio 
information having a standard MP3 file format with a header, audio data and auxiliary data, 
wherein the caption information includes position data and/or time data, and when the audio 
information is reproduced, the caption information synchronized with the reproduced audio 
information is outputted using the position data and/or the time data. 

The caption MP3 data format according to a second embodiment of the present 
invention has a format comprising a plurality of caption MP3 files, each of the caption MP3 
files having audio information and corresponding caption information, the audio information 
having a standard MP3 file format with a header, audio data and auxiliary data; wherein the 
audio information is located before the caption information in the each MP3 file, and the 
caption information includes caption display time data showing the time indicated in a display 
device when the caption information is reproduced. 

According to the present invention, the caption information can be included in the 
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standard MP3 information, in which the audio information is stored, and the caption 
information can be provided along with the audio information by synchronously outputting 
the caption information with the audio information using the position data and/or time data. 

The present invention has an advantage in that there is no noise by the intervention . 
between the caption information and the audio information since they are separated. 

The present invention has an advantage in that the caption information is stored in 
the form of a digital signal so that the caption information can be stored in various formats 
such as an image, hypertexter, text, etc. and that the deterioration in sound quality by repeated 
reproduction is prevented. 

Further, there is an advantage in that the file format, in which the audio and the 
caption are synchronized, makes searching and movement between intervals faster and easier. 



FIG. 1 is a block diagram of a caption MP3 player format according to the present 
invention. 

FIG. 2 is a view illustrating a caption MP3 data format according to the first 
embodiment of the present invention. 

FIG. 3 is a flow chart showing a caption MP3 data reproduction method according to 
the first embodiment of the present invention. 

FIG. 4 is a view illustrating the caption MP3 data format according to the second 
embodiment of the present invention. 

FIG. 5 is a flow chart showing the method of reproducing caption information in the 
caption MP3 data according to the second embodiment of the present invention. 



The construction and operation of the present invention will be explained in detail 
with reference to the accompanying drawings. 

FIG. 1 is a block diagram of an MP3 player having a caption display function 
according to the present invention. The caption MP3 player according to the present 
invention comprises an input section (11), storage section (12) for storing audio information 
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and/or caption information, signal separation section (13) for separating the audio information 
and the caption information, control section (10), audio output section (16), caption output 
section (14) and display section (15). 

The audio information and the caption information are inputted through the input 
5 section (11) from a recording medium (18) in which caption MP3 files are recorded. The 
input section (11) is preferably an electric circuit comprising a connection port. The audio 
information and the caption information inputted through the input section (11) are stored in 
the storage section (12), preferably a memory cell. The signal separation section (13) 
separates the audio information and the caption information stored in the storage section (12). 

10 The control section (10) controls the storage of information in the storage section 

(12) or the output of information from the storage section (12), and synchronizes audio 
signals and caption signals that are separated in the signal separation section (13). Also, the 
control section (10) counts playing time while the audio information is being reproduced. 
The control section (10) is preferably a microcomputer having function of processing signals 

15 or a control circuit comprising a microcomputer, and is formed to be controlled by a user. 

The audio output section (16) receives the audio signal corresponding to the audio 
information among the information from the signal separation section (13) and sends the 
signal to a left speaker (L SPK) and a right speaker (R SPK) so that the signal is outputted as 
an audio signal that can be heard. The caption output section (14) outputs the caption signal 

20 corresponding to the caption information among the information from the signal separation 
section (13) in synchronism with the audio signal outputted from the audio output section (16). 
The display section (15) displays the caption corresponding to the caption signal outputted 
from the caption output section (14) in a visible form on the screen. Preferably, the display 
section is a liquid crystal display (LCD). 

25 In the caption MP3 player of the present invention having such a construction as 

described above, when the audio information and the caption information are inputted through 
the input section (11) from the caption MP3 file recorded in the recording medium (18), the 
audio information and the caption information are stored in the storage section (12) through 
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the control of the control section (10). Each information stored in the storage section (12) is 
outputted from the storage section (12) through the control section (10) controlled by the user 
when the output of information is required. The outputted information is separated into 
audio information and caption information through the signal separation section (13), and the 
separated audio signal is outputted to the speaker in the monophonic or stereophonic mode 
through the audio output section (16). The separated caption signal is synchronized with the 
audio signal and outputted on the display section (15) through the caption output section (14). 



A caption MP3 data format according to the first embodiment of the present 
invention will be described. 

FIG. 2 is a view showing a caption MP3 data format according to an embodiment of 
the present invention. The caption MP3 information according to the present invention 
consists of audio information (20) and caption information (22). The audio information has 
a standard MP3 file format with a header, CRC, audio data and auxiliary data. The header is 
located on a fixed field of 32-bits and in that field, information, such as a layer, sampling 
frequency and remaining frame, is contained. As an option, the existence or nonexistence of 
CRC depends on the header. Audio data is compressed data, and the length of data depends 
on the kind of the data. The auxiliary data, as a user definition area, includes additional 
information and is variable in dimension. 

Each caption information (22) comprises a start synchronization code (1), 
reproduction number data (2) and information data (8). It is not necessary to arrange these 
elements in the order as shown in FIG. 2. The arrangement shown in FIG. 2 is just an 
example for description. 

The start synchronization code (1) of the caption information (22) means the 
beginning of the caption information. The reproduction number data (2) is located after the 
start synchronization code (1) and indicates the number for indicating to which audio 
information frame among a plurality of pieces of audio information (20) the caption 
information corresponds. It can be understood that the reproduction number is the position 
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data of the audio information with which the caption information should be synchronized or 
the position data of the caption information with which the audio data should be synchronized. 
The reproduction number data indicates the number, which is used for reference when the 
audio information (20) and the caption information (22) are reproduced, and is formed with a 
5 size of 4-bits, for example. 

The information data (8) include the related information such as the address of data 
or the kind of data to be stored and also includes, for example, reproduction address data (3), 
information identification code (4), selection code (5) and caption data (6). 

The reproduction address data (3) shows the reproduction number, by which the 

10 caption information is combined with each other when a plurality of pieces of caption 
information are in the form of one word or picture, and is formed with a size of 4-bits, for 
example. To form a paragraph of large amount, at least one or more pieces of the caption 
information are required. The information identification code (4) shows of what type a 
stored information file is. The file can be in the form of an image file, hypertext file 

1 5 (HTML) or text file, for example, which is adapted for the display device. 

The selection code (5) indicates at least one of the language form used in the stored 
information, operation time and display mode of the display section (15). The form of the 
used language can be, for example, Korean (KOR), Japanese (JP), English (USA), etc., and 
the operation time is the time at which the caption information should be outputted. By 

20 using the operation time, the caption information is synchronized with the audio information. 
The display mode shows whether the caption in the form of a word or sentence is outputted 
on the display section (15) in sequence or at once, and determines in what form (for example, 
20 columns and 4 lines or 24 columns and 2 lines) the characters should be displayed. 

By using the operation time of the selection code (5), it is possible to output the 

25 caption information in synchronism with the audio information. For such synchronization, 
the operation time data and the reproduction number data (2) can be used together or 
separately. 

The caption data (6) shows the caption character outputted from the MP3 recording 
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medium. The character stored at this time can be, for example, in the form of an image, 
hypertext, text, etc. 

When a caption information group (22a) comprising a plurality of pieces of caption 
information (22) formed as such is added to an MP3 data format (20a) comprising several 
pieces of audio information (20) of an audio decoding unit and is outputted from the 
recording medium in which the MP3 audio information (20) is stored, the caption character is 
outputted in synchronism with each audio signal extracted from a plurality of pieces of audio 
information (20). The MP3 data group (20a) forms one MP3 file that for example, 
corresponds to a song. The caption data group (22a) includes the contents of caption 
corresponding to one MP3 data format (20a), and each of a plurality of pieces of caption 
information (22) corresponds to one word or sentence that forms the contents of the caption. 

The recording medium comprises an optical recording apparatus such as a compact 
disc, audio tape, magnetic recording apparatus, such as a hard disc, and memory. 

A plurality of pieces of audio information (20) included in the MP3 audio 
information (20a) each has a 32-bit header and 16-bit CRC, audio data and additional data. 

Reproduction of the information having such a caption MP3 data format will be 
explained with reference to the flow chart of FIG. 3. 

The recording medium is inserted into an apparatus reproducing the signal stored in 
the recording medium, e.g., the MP3 player shown in FIG. 1, and the stored information is 
reproduced by the control of the control circuit including a microcomputer of the reproducing 
apparatus. 

At least one of the audio information (20) and the caption information (22) is stored 
in the MP3 recording medium (step 30) so that the synchronized audio signal and the caption 
signal are outputted for reproduction. The control circuit determines whether the audio 
information (20) only exists in the information stored in the recording medium (step 32). 

At the determining step (32), when it is determined that the audio information (20) 
exists in the recording medium without the caption information (22), the audio information 
(20) only is outputted from the recording medium (step 34) because the caption information 

8 
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(22) is not outputted and thus does not exist. 

However, when it is determined that the caption information (22) exists in the 
recording medium, the caption signal and the audio signal are reproduced in synchronism 
with the caption information according to the existence and/or non-existence of the audio 
5 information (20) in the recording medium, and then the reproduction of the next caption 
signal or audio signal is repeated (steps 36-48). 

As a first determining step, to reproduce all of the desired caption information and 
the audio information during the above repetition, it should be determined first whether the 
caption information (22) and the audio information (20) exist together in the recording 
10 medium (step 36). 

At the first step (36), if it is determined that the caption information (22) exists 
without the audio information (20), the caption information (22) only is outputted (step 38). 
In the meantime, the caption information (22) exists in the first step (36) together with the 
audio information (22), the compressed audio information (20) is decoded for reproduction 
] 5 (step 40). 

As a second determining step, it is determined whether the caption information (22) 
corresponding to the audio information (20), which is decoded at the decoding step (40) so 
that when the reproduction apparatus outputs an audio, a corresponding caption can be 
outputted (step 42). If there is no corresponding caption information, output of information 

20 is maintained by continuously outputting the already outputted caption information or a 
caption information having a blank character (step 44). 

However, if there is caption information (22) corresponding to the audio information 
(20), the caption information is decoded according to the file form of the caption information, 
for example, image, hypertext, text, etc (step 46). 

25 Then, the caption information is synchronized with the corresponding audio 

information, which is decoded at the decoding step (40), in the reproduction apparatus and 
outputted (step 48), and the first determining step (36) returns to output the next caption 
information. 
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For example, by the caption information (22) added to the audio information (20), 
the sound "beau-" and the character "beau-" synchronized with the sound "beau-" are 
outputted from the respective output apparatuses, i.e., the speaker from which the audio 
information (20) is outputted and the display device from which the caption information (22) 
5 is concurrently outputted. At this time, since the audio information (20) and the caption 
information (22) have a capacity capable of storing at least a part of the audio signal and the 
caption signal, which are to be "beau-," the audio information (20) and the corresponding 
caption information (22) are required to store words such as "beautiful". 

In this manner, the audio information (20) stored in the caption MP3 recording 
10 medium and the caption information (22) synchronized to correspond to the audio information 
are simultaneously reproduced as audio and caption through the respective output apparatuses. 

Second Embodiment 

As shown in FIG. 4, an MP3 data format (50) according to a second embodiment of 

the present invention comprises a plurality of caption MP3 files (50a, 50b, . . .). Each 
15 caption MP3 file has audio information (52) and caption information (54). The audio 

information (52) comprises standard MPEG audio files as that in the first embodiment. 

In FIG. 4, the caption information (54) comes after the audio information (52). In a 

different way, the caption information (54) could come before the audio information (52). 

However, when considering the wide utility of software for MP3 file reproduction, it is 
20 preferable to use the structure shown in FIG. 4. 

In FIG. 4, one MP3 file (e.g., 50a) appears to comprise one audio information (52a) 

and one caption information (54a). However, that is just for simplification of the drawing. 

One skilled in the art could understand that substantially in the most caption MP3 files, one 

file comprises a plurality of pieces of audio information and a plurality of pieces of 
25 corresponding caption information. One MP3 file corresponds to one paragraph of phonetic 

information that is divided, for example, by a tune of song and a predetermined basis (e.g., 

theme). 

Each of the caption information 1 and 2 (54a and 54b) comprises a caption start 

10 
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synchronization signal (56), caption data 1, 2, ... N (58a, 58b, . . . , 58n), text type (67) and 
caption identification code (62). The caption start synchronization signal (56), for example, 
as 4-byte data, indicates the start position in which the caption information is contained. The 
caption data (58) contains the character information to be displayed on the real screen and its 
5 size changes according to the character information. The caption data (58) will be explained 
hereinafter. 

Text type (60) determines the type, i.e., form of text output so that for example, the 
character information in the caption data (58) is outputted, being formed into 20 columns and 
4 lines or 24 columns and 2 lines. The caption identification code (62) is a code that 

10 identifies whether the data format is the caption MP3 file. Each of the caption data 1,2,.., 
N (58a, 58b, . . . , 58n) is formed to include a caption display time (64), sentence start 
identification (66), caption (68), additional data (70), option (72) and the size of data (74). 

The caption display time (64) as the time data of a point of time to display the 
caption is sized, for example, to be 7 bytes. The sentence start identification (66) is a code 

15 to find the beginning of the sentence when the sentence is displayed on different screens. 
The caption (68) is character data to be displayed on the screen, and the additional data (70) is 
used when an information except the option is required and contains the information that 
shows the form of the caption information file (image file, hypertext file, text file) or indicates 
the language of the caption information. The option (72) is a storage place for so-called 

20 optional matters that stores the information such as a scroll form (e.g., the character is 
displayed, flowing on the screen, or a previous sentence disappears slowly and the next 
sentence appears slowly on the same place) or a flash (e.g., flickering of letters). Into the 
data size (74), information on the length of the caption data is inputted. 

In the caption MP3 file of such an information format, the audio information and the 

25 caption information are synchronized with each other by the caption display time (64) data. 
The synchronization by the use of time information is more advantageous than that by the use 
of the position data and has a lower rate of failure. 

In the meantime, as described above, the standard MP3 file has a format comprising 

11 
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a header, a CRC, audio data and additional data. It can be considered that the caption 
information is included in the additional data of the standard MP3 file. However, since the 
compression rate varies depending on the amount of the audio data, it is therefore easier to 
add the caption information as a separate file format as in the first and second embodiments 
5 according to the present invention than to include the caption information in the additional 
data. Further, there are many advantages such as the prevention of noise by the interruption 
occurring between the caption information and the audio information. 

FIG. 5 is a flow chart showing the method of reproducing the caption information in 
the caption MP3 file according to the second embodiment of the present invention. 

10 The file stored in the recording medium is opened; it is identified using the caption 

identification code (62) of the caption information (54) whether the caption information is in 
the file to be reproduced; the caption information is stored in the storage section (12) of the 
caption MP3 player if the caption information is included in the file and then the caption 
information is reproduced. When the reproduction of the caption information initiates, the 

1 5 caption information is initialized (step 80). At the step of initializing the caption information 
(80), it is determined whether to delete the caption displayed on the display device and to 
which file the caption data is attached. The reproduction terminates at the termination step 
(85). Otherwise, the playing time, which is reproduced in units of 1/1000 sec, is brought 
(step 86). This playing time has a value counted by the reproduction apparatus, for example, 

20 the control section (10) of the caption MP3 player shown in FIG. 1. The playing time is 
compared with the caption time (step 88). The caption time, as a caption display time (64a) 
of the caption data (58), is the time data value of a point of time at which the caption is 
displayed. The next caption time data is brought (step 90) and then the caption information 
is outputted (step 92). After returning to the termination-of-reproduction determining step 

25 84 (step 94), steps 86-92 are repeated. 

Although the present invention has been described with reference to the drawings, it 
is understood that this description is not to limit the invention to the embodiments shown in 
the drawings but simply to explain the invention. One skilled in the art will understand that 

12 
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various changes and modifications can be made from the embodiments disclosed in the 
specification. Therefore, the scope of the present invention should be defined by the 
appended claims. 



13 
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CLAIMS 

1 A caption MP3 player for reproducing a caption MP3 information including audio 

information having a standard MP3 file format comprising a header, audio data and auxiliary 
data, and corresponding caption information having position data and/or time data for the 
caption information, the caption MP3 player comprising: 

a storage means for storing the inputted audio information and corresponding caption 
information; 

a signal separation means for separating the audio information and caption 
information provided from the storage means; 

a control means for controlling storage and output of the information through the 
storage means and controlling synchronization of the audio information and the caption 
information separated by the signal separation means; and 

a caption output means for receiving an output of the signal separation means, and 
outputting the caption information synchronized with the audio information which 
corresponds to the caption signal and is outputted from the audio output means.. 

2. The caption MP3 player according to claim 1, wherein the caption output means is a 
liquid crystal display. 

3. A caption MP3 data format comprising audio information having a standard MP3 file 
format comprising a header, audio data and auxiliary data, and corresponding caption 
information, wherein the caption information includes position data and/or time data, and 
when the audio information is reproduced, the caption information synchronized with the 
reproduced audio information is outputted using the position data and/or the time data. 

4. The caption MP3 data format according to claim 3, wherein the caption information 
comprises an initiation section indicating initiation of the caption information and an 
information section, the position data is a reproduction number data indicating to which frame 
of the reproduced audio information the caption information corresponds, and the 
reproduction number data is included in the information section. 

5. The caption MP3 data format according to claim 3, wherein the information section 

14 
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comprises: 

a reproduction address data for indicating a reproduction address that combines the 
caption information with each other if a plurality of pieces of caption information form one 
word or picture; 

5 an information identification code for indicating a kind of files form of a stored 

information; 

a selection code for indicating at least one of a language form used in the stored 
information, operation time and display mode; and 

caption data including caption characters. 
10 6. An MP3 data reproduction method for controlling output of audio information and/or 

caption information from a recording medium, the method comprising the steps of: 

determining whether only audio information exists among the information stored in 
the recording medium; 

outputting the audio information from the recording medium if it is determined that 
1 5 only the audio information exists; and 

reproducing the audio information in synchronism with the caption information if it 
is determined that both the audio information and the caption information exist, and 
repeatedly reproducing next audio and caption information. 

7. The MP3 data reproduction method according to claim 6, wherein the reproducing 

20 step comprises the steps of : 

firstly determining whether the caption information and the audio information exist 
together in the recording medium; 

outputting the caption information if the first determining step determines that the 
caption information exists but the audio information does not exist; 
25 decoding the audio information if the caption information and the audio information 

exist together at the first determining step; 

secondly determining whether the caption information corresponding to the audio 
information exists; 
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outputting for the next caption information or blank caption information if the second 
determining step determines that the corresponding caption information does not exist; 

interpreting information according to a form of a file comprising the caption 
information if the second determining step determines that the corresponding caption 
information does not exist; and 

restarting the first determining step to output the corresponding caption information 
by synchronizing the caption information with the decoded audio information and to output 
the next caption information. 

8. A caption MP3 data format comprising a plurality of caption MP3 files, wherein; 
each caption MP3 file comprises audio information and corresponding caption 

information, the audio information having a standard MP3 file format including a header, 
audio data and auxiliary data; and 

the audio information is located before the caption information in each caption MP3 
file, the caption information having caption display time data for indicating a caption display 
time on a display when the caption information is reproduced, 

9. The caption MP3 data format according to claim 8, wherein the caption information 
comprises: 

a caption start synchronization signal for indicating a start position at which the 
caption information is located; 

a plurality of pieces of caption information having character information to be 
displayed on display; 

a text type for determining an output type of the character information; and 

a caption identification code; 

wherein the caption display time data is included in each of the plurality of caption 
data and is compared with a play time counted when the caption MP3 file is reproduced. 

10. The caption MP3 data format according to claim 9, wherein each of the caption data 
comprises: 

a sentence start identification code for indicating a beginning of characters presented 
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by the caption data; 

a caption section comprising character data to be displayed on the display; 
additional data containing a scroll type and flash information; and 
a data size containing length information of the caption data. 

11. A method of reproducing caption MP3 data comprising audio information having a 
standard MP3 file format comprising a header, audio data and auxiliary data, and 
corresponding caption information, the method comprising the steps of: 

identifying step for identifying whether the caption information exists in the caption 
MP3 data to be reproduced; 

reproducing the audio information if it is determined that the caption information 
does not exist at the caption information identifying step; 

initializing the caption information if it is determined that the caption information 
exists at the caption information identifying step; 

bringing a play time while reproducing the caption MP3 files; 

comparing the play time with a display time of the caption information; 

bringing the display time of next caption information; and 

displaying the caption information. 

12. The caption MP3 data reproducing method according to claim 11, further comprising 
the steps of: 

determining termination of reproduction after the audio information reproducing 

step; and 

returning to the termination of reproduction determining step after the caption 
information displaying step. 



17 



Page Blank (uspto) 



WO 00/41175 




PCT/KR99/00838 



1 / 5 



FIG.l 



5g 



CL 



GO 



no 






2 




O 




CTI 




LU 
CO 



COLLI 
Q I 



Page Blank (uspto) 



WO 00/41175 




PCT7KR99/00838 



2/5 



FIG. 2 



ID 

cc 

ZD 

o 

ZD 
CC 

Q { 

tr 
o 



o 

CM 



3 

o 
t 

5 



GjO 
coO 



UJ 



— C73 

.CO 

ocg< 
Q-Qh 
ujO< 
cr<0 



.cc 
ccS£< 

UJZ>< 



co coo 



o 

CM 



V 

\ 



2< 



S5co 

< CD 
X co 



DP 



Si 



"2 

O . 

Q. 5 
< 



£1 



o- 

cc 

o 



o- 

cc 

o 



..CM 
CM 



Page Blank (uspto) 



WO 00/41175 




PCT/KR99/00838 



3 / 5 



FIG. 3 



C START } 

STORE AUDIO INF. 
AND CAPTION INF. ' 




YES 



NO 



DECODE AUDIO 

INF. FOR REPRODUCTION. 




ANALIZE KIND 
OF CAPTION INF. 


*? 




SIMULTAN 
OUTPUT / 
AND CAP1 


EOUSLY 
WDIO INF. 
HON INF. 





f 34 




OUTPUT AUDIO 




INF. FROM 




RECORDING MEDIUM. 





f 38 




OUTPUT CAPTION 
INF. 





,44 




OUTPUT PREVIOUS OR 
BLANK CAPTION INF. 



Page Blank (uspto) 



WO 00/41175 




PCT/KR99/00838 



A / 5 



FIG. 4 




64 66 68 70 72 74 



lh \sPageB\anKluspto) 



WO 00/41175 




PCT/KR99/00838 



5/5 



FIG. 5 



94. 



INITIALIZE CAPTION 
INFORMATION. 




-80 



-82 



REPRODUCTION^ YES 



BRING PLAYTIME. 

I 



COMPARE PLAY TIME 
WfTH CAPTION TIME. 



I 



-86 



-88 



BRING NEXT CAPTION TIME OATA. 



85>-^( END ) 



•90 



OUTPUT CAPTION. 



•92 



Page Blank lusp'ol 



INTERN ATIOJ^ SEARCH REPORT ^|rnational application No. 

VpbT/KR99/00838 



A. CLASSIFICATION OF SUBJECT MATTER 
IPC7 GI1B 20/04 

According to International Patent Classification (IPC) or to both national classification and IPC 



B. FIELDS SEARCHED 



Minimun documentation searched (classification system followed by classification symbols) 
IPC7 G11B 20/04 G11B 20/00 Gl IB 27/00 Gl IB 27/34 H04B 1/00 



Documentation searched other than minimun documentation to the extent that such documents are included in the flleds searched 



Electronic data base consulted during the intertnational search (name of data base and, where practicable, search trcrms used) 
WPI "MEMORY" "MUSIC" "AUDIO" "DATA" "PLAY" "RYLIC" "TEXT" "CAPTION" 



C DOCUMENTS CONSIDERED TO BE RELEVANT 



Category* 



Citation of document, with indication, where appropriate, of the relevant passages 



Relevant to claim No. 



EP 0 390 048 (MATSUSHITA) 27 MARCH 1990, 
Claim 1-3, 
Claim 4,5 

EP 0 626 689 (PIONEER) 26 MAY 1994, 
Claim 3-8, 
Claim 14-16 

US 5,161,251 (MANKOVITZ) 3 NOVEMBER 1992 



1,3 

4,5,7,8,9 



U5 

3,4,6-12 
1,3-12 



□ 

Further documents are listed in the continuation of Box C. | | See patent family annex. 



"A" 

■E" 



Special categories of cited documents: 

document defining the general state of the art which is not considered 
to be of particular rclcvcnce 

earlier application or patent but published on or after the international 
filing date 

document which may throw doubts on priority claim(s) or which is 
cited to establish the publication date of citation or other 
special reason (as specified) 
'O" document referring to an oral disclosure, use, exhibition or other 
means 

"P" document published prior to the international filing date but later 
than the priority date claimed 



"T" later document published after the international filing date or priority 

date and not in conflict with the application but cited to understand 
. the principle or theory underlying the invention 
"X" document of particular relevencc; the claimed invention cannot be 

considered novel or cannot be considered to involve an inventive 

step when the document is taken alone 
"Y" document of particular rclevence; the claimed invention cannot be 

considered to involve an inventive step when the document is 

combined with one or more other such documents, such combination 

being obvious to a person skilled in the art 

document member of the same patent family 



Date of the actual completion of the international search 
14 APRIL 2000 (14.04 .2000) 



Date of mailing of the international search report 
25 APRIL 2000 (25.04.2000) 



Name and mailing address of the ISA/KR 
Korean Industrial Property Office 

Government Complex-Taejon, Dunsan-dong, So-ku Taejon 
Metropolitan City 302-701, Republic of Korea 

Facsimile No. 82-42-472-7140 



Authorized officer 

SEO, Hawthorne 
Telephone No. 82-42-48 1-5693 



\ x£ ':■ few****** 



Form PCT/ISA/210 (second sheet) (July 1998) 



Page Blank (uspto) 



